Combining and scaling descent and negative curvature directions

نویسندگان

  • Catarina P. Avelino
  • Javier M. Moguerza
  • Alberto Olivares
  • Francisco J. Prieto
چکیده

The aim of this paper is the study of different approaches to combine and scale, in an efficient manner, descent information for the solution of unconstrained optimization problems. We consider the situation in which different directions are available in a given iteration, and we wish to analyze how to combine these directions in order to provide a method more efficient and robust than the standard Newton approach. In particular, we will focus on the scaling process that should be carried out before combining the directions. We derive some theoretical results regarding the conditions necessary to ensure the convergence of combination procedures following schemes similar to our proposals. Finally, we conduct some computational experiments to compare these proposals with a modified Newton’s method and other procedures in the literature for the combination of information.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Exploiting Negative Curvature in Deterministic and Stochastic Optimization

This paper addresses the question of whether it can be beneficial for an optimization algorithm to follow directions of negative curvature. Although some prior work has established convergence results for algorithms that integrate both descent and negative curvature directions, there has not yet been numerical evidence showing that such methods offer significant performance improvements. In thi...

متن کامل

Exploiting Negative Curvature Directions in Linesearch Methods for Unconstrained Optimization

In this paper we consider the deenition of new eecient linesearch algorithms for solving large scale unconstrained optimization problems which exploit the local nonconvexity of the objective function. Existing algorithms of this class compute, at each iteration, two search directions: a Newton-type direction which ensures a global and fast convergence, and a negative curvature direction which e...

متن کامل

Curvilinear path steplength algorithms for minimization which use directions of negative curvature

The Armijo and Goldstein step-size rules are modified to allow steps along a curvilinear path of the form x(a) = x + as + a2d, where x is the current estimate of the minimum, s is a descent direction and d is a nonascent direction of negative curvature. By using directions of negative curvature when they exist, we are able to prove, under fairly mild assumptions, that the sequences of iterates ...

متن کامل

Computing Modified Newton Directions Using a Partial Cholesky Factorization

The effectiveness of Newton’s method for finding an unconstrained minimizer of a strictly convex twice continuously differentiable function has prompted the proposal of various modified Newton methods for the nonconvex case. Line search modified Newton methods utilize a linear combination of a descent direction and a direction of negative curvature. If these directions are sufficient in a certa...

متن کامل

A box-constrained optimization algorithm with negative curvature directions and spectral projected gradients

A practical algorithm for box-constrained optimization is introduced. The algorithm combines an active-set strategy with spectral projected gradient iterations. In the interior of each face a strategy that deals efficiently with negative curvature is employed. Global convergence results are given. Numerical results are presented.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Math. Program.

دوره 128  شماره 

صفحات  -

تاریخ انتشار 2011